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FACTOR  STABILITY  OF  THE  WORK  ENVIRONMENT  QUESTIONNAIRE 


BACKGROUND 


Many  instruments  have  been  developed  during  the  past  10  to  IS  years 
for  the  purpose  of  surveying  organizations,  to  assess  attitudes  or  climate, 
to  diagnose  problems  with  organizational  processes,  or  to  deal  with  other 
concerns.  Unfortunately,  many  of  these  instruments  have  not  been  sufficiently 
well  studied  to  assure  their  reliability  and  validity.  One  project  of  the 
Organizational  Effectiveness  Technical  Area  has  been  the  development  of  a 
reliable  and  valid  organizational  diagnostic  instrument  called  the  Work 
Environment  Questionnaire  (WEQ) .  A  detailed  report  on  the  initial  develop¬ 
ment,  reliability,  and  validity  of  the  WEQ  in  an  ongoing  Army  work  environment 
was  provided  by  Turney  and  Cohen  (197b).  The  present  research,  an  effort 
to  cross-val idate  the  WEQ,  focuses  on  the  stability  of  the  factor  structure 
of  the  WEQ  in  a  second  Army  work  environment. 


Interpretations  of  factor  analysis  and  comparisons  of  factor  structures 
have  most  frequently  been  subjective  assessments  by  the  researchers.  However, 
Harman  (19b7)  presents  a  coefficient  of  congruence  which  provides  a  quanti¬ 
tative  measure  of  the  degree  of  congruence  between  factor  loadings  of 
variables  between  two  independent  samples.  This  coefficient  of  congruence 
is  verv  similar  in  form  to  a  product-moment  coefficient  of  correlation.  It 
can  range  in  value  from  /l  for  perfect  congruence  between  two  sets  of  factor 
loadings;  through  0  for  a  complete  absence  of  congruence  between  two  sets 
of  loadings;  to  -1  for  a  perfect  invense  congruent  relationship  between  two 
sets  of  loadings.  Harman  suggests  that  the  coefficient  of  congruence  is  an 
appropriate  method  for  the  identification  of  common  factors  across  different 
survey  samples. 

T  ,,  i** 

The  present  report  examines  the  factor  stability  of  the  WEQ  across  two 
samples  of  soldiers  working  in  different  types  of  work  environments. 


METHOD 

Sample 


The  survey  was  conducted  as  part  of  the  initial  diagnostic  phase  of 
an  organizational  effectiveness  program  being  conducted  in  two  Armv  commands. 
Questionnaires  were  completed  in  small  groups  during  duty  hours. 

The  survey  respondents  were  US  Army  enlisted  personnel.  Sample  1 
consisted  of  122  communications  specialists  at  a  field  station  in  Germany. 

One  hundred  and  seventeen  questionnaires  (95.9%)  were  filled  out  completely. 

The  respondents  in  Sample  2  were  580  members  of  32d  AADGOM  missle 
batteries  at  13  sites  in  Germany.  Complete  data  were  available  for  535 
respondents  (95.0%)  in  Sample  2. 
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Measures 


The  present  report  focuses  on  the  25-item  section  of  the  WEQ  concerned 
with  various  aspects  of  the  work  environment.  Item  format  was  a  seven- 
point  rating  scale  with  "strongly  agree"  and  "strongly  disagree"  as  the 
anchor  points.  The  questionnaire  included  Items  on  work  group  norms,  task 
requirements,  communication,  and  supervision.  Turney  and  Cohen  (1976) 
present  a  detailed  account  of  the  item  development  and  selection. 

St  at  istical  Computat ions 

The  data  from  the  two  samples  were  factor  analyzed  using  the  Statistical 
Package  for  the  Social  Sciences  (SPSS)  principal  factor  program  with  varimax 
rotation.  The  stability  of  the  factor  structure  was  then  evaluated  by 
computing  the  coefficient  of  congruence  (Harman,  1967)  between  all  inter¬ 
sample  pairs)  so  that  each  set  of  factor  loadings  in  one  sample  was  paired 
with  every  set  of  factor  loadings  in  the  other  sample. 

RESULTS 

The  SPSS  program  automatically  deletes  all  factors  with  an  associated 
eigenvalue  of  less  than  1.0.  This  criterion  resulted  in  a  five  factor 
solution  for  Sample  1  and  a  four  factor  solution  for  Sample  2.  A  second 
set  of  factor  solutions  was  calculated  so  that  both  the  four  and  five  factor 
solutions  were  available  for  Samples  1  and  2. 

Tables  1-4  present  the  four  and  five  factor  solutions  for  both  samp'es. 
The  four  factor  solution  for  both  samples  produced  Supervision,  Group 
Cohesion,  Job  Responsibility,  and  Performance-Reward  Contingency  as  factors. 
The  five  factor  solution  for  Sample  1  resulted  in  Supervision,  Supervision- 
Consideration/Performance-Reward  Contingency,  Job  Responsibility,  Group 
Cohesion,  and  Group  Performance  factors.  The  Sample  2  five  factor  solution 
had  Supervision,  Performance-Reward  Contingency,  Job  Responsibility,  Group 
Cohesion,  and  a  fifth  factor  with  no  items  having  high  loadings. 

Inspection  of  Tables  1-4  suggests  that  the  factor  solutions  for  the 
two  samples  are  very  similar.  This  conclusion  is  supported  by  the  coef¬ 
ficients  of  congruence  presented  in  Tables  5  and  6.  Table  5  shows  that 
four  factor  solution  coefficients  of  congruence  between  the  Sample  1  and 
Sample  2  Supervision,  Group  Cohesion,  and  Job  Responsibility  factors  are 
high  (0.96,  0.83,  and  0.87,  respectively).  Indicating  stability  of  these 
factors  over  the  two  samples.  The  Performance-Reward  Contingency  factor 
coefficient  of  congruence  is  moderately  high  (0.76),  but  the  coefficient 
of  congruence  between  that  factor  and  the  Supervision  factor  in  the  other 
sample  is  slightly  larger  for  both  Sample  l  (.78)  and  Sample  2  (.85).  This 
finding  suggests  some  overlap  between  the  Supervision  and  Performance-Reward 
Contingency  factors  in  both  samples. 

The  coefficients  of  congruence  for  the  five  factor  solution  (Table 
6)  lead  to  a  similar  conclusion.  The  Supervision,  Job  Responsibility,  and 
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Croup  Cohesion  coefficients  of  congruence  were  high  (0.94,  0.88,  and  0.78, 
respectively),  again  indicating  stability  of  the  factors  across  samples. 

Also,  as  in  the  four  factor  solution,  the  Performance-Reward  Contingency 
factors  have  high  coefficients  of  congruence  with  the  Supervision  factor. 

The  fifth  factor  in  Sample  1,  Group  Performance,  does  not  have  a  high 
coefficient  of  congruence  with  any  of  the  Sample  2  factors. 

DISCUSSION  AND  CONCLUSIONS 

The  coefficient  of  congruence  matrices  indicate  that  the  Supervision 
and  Performance-Reward  Contingency  factors  are  vey  similar.  The  high 
coefficients  of  congruence  between  these  two  factors  may  be  due  to  the 
role  of  the  supervisor  as  the  purveyor  of  rewards  in  the  work  environment. 

The  items  with  high  loadings  on  the  Performance-Reward  Contingency  factor 
all  specify  the  supervisor  as  the  agent  of  rewards.  Thus,  the  Performance- 
Reward  Contingency  factor  appears  to  focvis  on  one  role  of  a  supervisor — 
the  purveyor  of  rewards. 

The  high  interrelationship  between  the  Supervision  and  Performance- 
Reward  Contingency  factors  is  consistent  with  the  findings  of  Shiflett, 

Turney,  and  Cohen  (in  press).  When  Shiflett  et  al  examined  the  relationship 
of  ttie  WKQ  to  several  measures  of  job  facet  satisfaction  and  organizational 
characteristics,  they  found  many  of  the  variables  to  be  so  intricately 
intertwined  with  one  another  that  a  change  in  one  variable  was  likely  to 
result  in,  or  he  associated  with,  n  change  in  a  variety  of  other  variables. 

Examination  of  the  WKQ  items  suggest  that  the  WEQ  factors  are  similar 
to  those  found  in  other  organizational  diagnostic  instruments.  For  example, 
the  WEQ  Supervision  factor  appears  to  encompass  concepts  similar  to  the 
Consideration  and  Initiation  of  Structure  scales  in  the  Leadership  Behavior 
Description  Questionnaire  (Halpin  &  Winer,  1957).  The  Supervision  items  also 
are  similar  in  content  to  the  Supervisory  Leadership  scales  of  the  Survey  of 
Organizations  (SCO)  (Taylor  &  Rowers,  1972). 

The  Group  Cohesion  factor  of  the  WEQ  also  overlaps  in  content  those 
found  in  the  goal  emphasis  and  interactive  facilitation  subscales  of  the  S00 
Peer  Leadership  factor. 

Turney  and  Cohen  (197b)  have  demonstrated  the  reliability  and  validity 
of  the  WEQ.  The  present  paper  demonstrates  the  factor  stability  of  the 
instrument  over  two  heterogeneous  samples  of  soldiers.  The  men  in  one 
sample  were  specialists  in  highly  sophisticated  communication  equipment.  The 
J2d  AADCOM  sample  represented  a  cross  section  of  maintenance  and  operational 
personnel  for  a  missile  battery. 

The  Turney  and  Cohen  paper  and  the  present  paper  combine  to  provide 
strong  support  for  the  utility  of  the  WEQ  as  an  organizational  diagnostic 
instrument  for  the  identification  of  organizational  problem  areas  in  on¬ 
going  Armv  work  environments.  The  WEQ  has  been  demonstrated  to  be  a  reliable, 
valid,  and  factor  analytically  stable  Instrument  for  assessing  supervision, 
work  group  cohesion,  job  responsibility,  and  performance-reward  contingencies 
in  the  work  environment. 
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